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Abstract 

Understanding commuting local Hamiltonians (CLHs) is at the heart of many questions in 
quantum computational complexity and quantum physics: quantum error correcting codes, quan- 
tum NP, the PCP conjecture, topological order and more. 

We first consider the complexity of the problem of approximating the ground value of a fc-local 
CLH; The complexity of the exact case remains unclear despite significant effort 1 18 3 51 37], and 
the approximation case is tightly related to the major conjecture of quantum PCP. We show that if 
the underlying interacting graph of the CLH instance has small-set expansion which is e close to 
optimal, then the approximation problem to within a factor 0(e) lies in NP. Thus, the better the 
expander, the easier it is to approximate. This puts a bound on the complexity of CLH on small- 
set expanders, and indicates that known PCP constructions such as Dinur's E7I , whose output 
instances are small-set expanders, cannot be used to prove a PCP theorem for CLH. 

We next proceed to study the much related topic of locally testable quantum codes based on 
local stabilizers; these are ground states of CLHs. We show that the better the small-set expan- 
sion of the interaction graph underlying the stabilizer becomes, the less robust the code becomes. 
This phenomenon seems to be inherently quantum. We combine the above result with an upper 
bound we prove on the robustness of stabilizer codes with bad expansion (which is a classical 
phenomenon) to derive a bound on the robustness of quantum LTCs with an arbitrary underlying 
interaction graphs. We derive non- trivial bounds on the robustness of quantum LTC codes; To the 
best of our knowledge the quantum LTCs were not studied before. 

Finally, we initiate the study of the quantum analogue of PCPs of proximity [13 1 which play 
a central role in classical PCPs; it is known that PCPPs induce LTCs with related parameters [13J, 
and we show this holds also in the quantum world; this connection between LTCs and PCPs 
further motivates the study of LTCs and their possible parameters. We defer the exposition of this 
part of our work to the next version of the paper. 

Much is left for further research, and in particular improving the range or applicability and 
generality of our results. Nevertheless we believe that the results highlight interesting limitations 
on quantum PCP and that they point at possible routes that might shed light on the stubborn PCP 
conjecture. 
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* School of Computer Science and Engineering, The Hebrew University, Jerusalem, Israel. 



1 Introduction 



This paper is concerned with commuting local Hamiltonians (CLHs). A fc-local Hamiltonian is a 
Hermitian matrix H = ^ Hi operating on the Hilbert space of n d-dimensional particles, where each 
term Hi (sometimes called constraint) acts non-trivially on at most k particles. For the Hamiltonian 
to be a fc-local commuting Hamiltonian we require in addition that every two terms Hi, Hj commute; 
W.L.O.G we assume in this case that H/s are projections. We denote the family of such Hamiltonians 
by CLH(k, d). Commutative local Hamiltonians have been the subject of very intense research for 
many years in physics; As it turns out, CLHs are related to some of the deepest questions in quantum 
computational complexity as well. Let us first provide the background and context for the questions 
we ask here regarding CLHs. 

1.1 Background and Context 

The computational complexity of the Local Hamiltonian problem Kitaev first defined in 1998 the 
local Hamiltonian (LH) problem, where one is given a local Hamiltonian on n qudits and two real 
numbers a, b, with b — a > 1 /poly(n), and is asked whether the lowest eigenvalue is at most a or larger 
than b; He showed [42] that this problem is complete for the class QMA, the quantum analogue of 
NP, providing a quantum counterpart of the celebrated Cook-Levin theorem. 

In 2003, Bravyi and Vyalyi |1T8| considered the similar decision problem for the commuting case; 
The commuting restriction might seem at first sight to devoid the LH problem of its quantum nature, 
since all terms can be diagonalized together, and moreover, one usually attributes the interesting fea- 
tures of quantum mechanics to its non-commutative nature, cf. the Heizenberg uncertainty principle; 
following this one might suspect that the commuting version trivially belongs to NP. This intuition 
however is misleading, since ground states of CLHs can exhibit intricate entanglement phenomenon, 
such as the topological order exhibited by the Toric code 11431 . Using clever applications of repre- 
sentations of C* -algebras Bravyi and Vyalyi Ifl8l gave a proof that the two-local commuting case 
indeed lies within NP, and this was generalized later to more general Hamiltonian classes |3"l l3"7H5Tl ; 
However the complexity of the general CLH problem remains unresolved. 

The resolution of the complexity of the CLH problem seems important on its own right, given the 
importance of commuting Hamiltonians in physics, its intriguing nature, its relation to multiparticle 
entanglement and its connection to topological order. But apart from these reasons, it is also related 
to the major open problem of whether a quantum analogue of the celebrated PCP (Probabilistically 
Checkable Proof) theorem holds; we will discuss this slightly later. 

CLH and quantum Error correcting codes Arguably the most important class of quantum error cor- 
recting codes are the stabilizer codes (see [34|); A stabilizer code is defined by a set of commuting 
generators, each generator being an element of the (generalized) Pauli group on n d-dimensional 
particles, i.e. a tensor product of n Pauli operators. The code is defined to be the simultaneous 1 
eigenspace of all generators (therefore these generators are called stabilizers); if all stabilizers are k- 
local (namely, only k out of the n Pauli's are non-identity), this can easily be seen to be equivalent 
to a ground space of a CLH(k, d) instance. Thus, CLHs and quantum stabilizer codes are intimately 
connected. A particularly beautiful example is that of the Toric code of Kitaev [43J mentioned before, 
due to the non-local entanglement it exhibits; Various other stabilizer codes exhibiting topological 
order were defined (see e.g. quantum double models [45] and many other stabilizer codes were con- 
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structed and studied (eg, ||34ll53ll54ll23ll25ll50l l58l). Many questions regarding stabilizer codes are 
of interest with much left to be understood: what are the possible parameters (distance, rate, etc.) of 
such codes, and what are the tradeoffs between those parameters ||2Tl I3T1 |59| , how efficient can the 
description of the states in those codes be 0, what are the various properties of such codes with re- 
spect to perturbations |Tl9ll20H and thermal fluctuations 11561 , their behavior in the presence of random 
noise 11261 |46l , all the above when constraints are restricted to be local, namely, the quantum analogue 
of LDPC codes ( I58[ 1591 146ll47| and references therein), and more. All those questions can be viewed 
as questions on CLHs, and their resolution is tightly related to our understanding of multiparticle 
entanglement, and of course to our understanding of the capabilities of quantum error correction. 

Quantum PCP Both the above topics are related to what is now considered a major challenge in 
quantum complexity theory: the quantum PCP conjecture. The classical PCP theorem (8j l2Zl is 
arguably the most important discovery in classical theoretical computer science over the past two 
decades; it states that there is a polynomial time reduction that maps a given Constraint Satisfaction 
Problem (CSP) instance (i.e., a collection of /c-local constraints on n Boolean or (i-state variables) 
into another CSP instance, such that if the original instance is satisfiable, then so is its image, but if 
the original instance is not satisfiable, then no assignment satisfies more than some constant c < 1 
fraction of constraints in the image instance. This implies that it is possible to check whether an 
assignment satisfies a given CSP or not, by reading only a constant number of random locations in 
the assignment (!). A major open problem is whether some quantum version of the PCP theorem 
holds EHH. A quantum PCP conjecture can be phrased as follows: 

Conjecture 1 Quantum PCP (qPCP) There exist constants c > 0,k, and a (quantum) poly-time algorithm, 
which takes an instance of a k-local Hamiltonian H, to another instance of a k-local Hamiltonian H', such 
that if H is satisfiable (namely, has ground energy 0), then so is H', but if H is unsatisfiable, the minimal 
eigenvalue of H' is at least c\\H'\\. 

A different way to state the theorem is to say that even the approximation of the ground energy 
of the given Hamiltonian to within a constant times its norm, is quantum NP hard; an equivalent 
formulation (see |4] for exact statement and a proof) is that QMA-hmd problems have a formulation 
in which the quantum witness can be tested by measuring only a constant number of random qudits. 

Attempts to extend the classical proofs of the PCP theorem to the quantum settings, or to dis- 
prove it, have encountered severe obstacles so far [2H6j[37H38]|. m particular, the classical proofs rely 
heavily on copying classical information; we cannot do the same in the quantum world, due to the 
no-cloning theorem. It seems that we do not understand some crucial issue about the local versus 
global behaviors of entanglement which is central to the problem. The resolution of the quantum PCP 
conjecture, either to the positive or the negative, is likely to shed light on multiparticle entanglement, 
with implications to computational complexity as well as to physics, e.g., to hardness of approxima- 
tion in the quantum setting, robustness of quantum correlations at room temperature, quantum error 
correction, topological order and more. 

Given the difficulty in making progress on the quantum PCP question so far, it is natural to restrict 
attention to commuting Hamiltonians. One one hand, one might hope to prove a quantum PCP 
theorem for commuting Hamiltonians, with the hope of borrowing ideas from such a proof to the 
more general case (this route might be useful even if eventually the general CLH problem turns out 
to be inside NP, which would collapse the commuting PCP theorem into the already known classical 
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PCP theorem). On the other hand, upper bounds on the hardness of approximating the CLH problem 
(such as putting the CLH approximation problem inside NP for certain approximation factors) could 
be considered as initial steps towards disproving the general PCP conjecture, or at least as limitations 
to its strength. This approach of attacking first the commuting case was taken by Aharonov and Eldar 
|3|, Hastings [37|, and Hastings and Freedman II38II . 

Locally Testable codes Classical PCP proofs rely heavily on a particular type of error correcting 
codes, called LTC codes (Locally Testable Codes) which are interesting in their own right. These are 
codes which satisfy the following property: Given a word of fractional distance S > from the code, 
we would like to detect that it is not in the code by randomly choosing a constant number k out of 
the n locations, and performing a simple test on those locations. The code is called a locally testable 
code (LTC) if such a test succeeds with probability s > 0, given that 5 > (there are variants on this 
definition, which we will discuss below). Note that the requirement for soundness when querying 
a constant number of locations is reminiscent of the similar goal in the context of PCP, in which 
querying a constant number of bits of a proof is supposed to detect that the proof is incorrect with 
constant probability. Indeed, locally testable codes, such as the Hadamard and the long code ll36llT6l 
have played a central role in the proofs of the PCP theorem (I81I71I2"7|). 

One can make the connection between the classical PCP theorem and LTCs more rigorous. It is 
possible to define a strong version of PCP, called PCP of proximity (PCPP) [13 j, which is a structure 
hidden in most known PCP proofs; Ben-Sasson et. al. showed [13J how given a PCPP, one can take 
a good code and construct from it a good LTC code, which inherits its local testability parameters 
(soundness and number of queries) from those of the PCPP [13 j. 

To the best of our knowledge, quantum LTCs and their robustness were not studied before, and 
neither was the notion of quantum PCPPs. 

1.2 Our contribution 

In this paper we attempt to gain new insights into the above topics. To do that, we consider an 
important facet, central to all the above issues: the topology of the interaction graph underlying the 
set of constraints. 

Constraint satisfaction problems on a lattice, both in the quantum and classical case, can be easily 
approximated in polynomial time to within factors which are even sub-constant. This is done by 
throwing away constraints that disconnect the lattice to logarithmic sized boxes which can be solved 
separately. On the other hand when the underlying graphs of the classical problem are expanders, the 
constraint satisfaction problem can exhibit extreme robustness against even constant approximation 
factors, as in the PCP theorem (see Dinur's proof [271 19|). 

Expansion of the interaction graph plays a crucial role in the context of error correcting codes as 
well; Classical expander codes were defined in ||57[ [5J, |52j| . In the quantum regime quantum codes on 
expanders have not been explored very thoroughly, though see 115811381 . 

In the above mentioned results, expansion is referred to loosely; several definitions of expansion 
are used in the literature, and we have not specified which one is being used. To be concrete, we need 
to choose a good expansion definition for our context. We first observe that crucially, the graphs we 
work with are A;-local hypergraphs for k > 3. This because the two-local case of commuting Hamil- 
tonians is not interesting from our point of view; 2-local CLH is known to be in NP fl8f, and exhibits 
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only local entanglement, and stabilizer codes with 2-local check terms cannot correct quantum errors 
for similar reasons. We therefore need to work with hypergraphs, or with CLHs with k > 3 locality. 

One possible route to take is to use one of the known definitions for expansion in hypergraphs: 
geometric, homological or spectral; (for references and a survey see I1481D . However it is unclear 
which of those makes more sense and the relations between them are not all known [48|. One could 
also choose to work with a graph underlying the hypergraph (connecting any two nodes that appear 
in the same constraint); This definition loses much of the "structure" of the original hypergraph. We 
choose to work here with the natural bi-partite graph induced by the hypergraph (as in e.g., [52 . 24J). 
We define the induced bi-partite graph G = (L, R; E) with constraints on the left, and variables / 
qudits on the right (see definition [2j, and a variable is connected to the constraints it appears in. We 
say that such a graph is an e small-set bi-partite expander, if for any set S of size at most k particles, 
the number of local terms incident on these particles is at least Dr\S\(1 — e), where Dr is the right 
degree of the graph. We note that Dr\S\ is the maximal possible number of constraints acting on 
those particles, so e can be viewed a "correction" to this number. 

We remark that our definition cares about the expansion of only constant-size sets, whereas usu- 
ally, one refers to small-set expanders as those graphs where all sets of size some linear fraction of 
\R\ are required to expand [29j[49l. We will address this point also in section ( |1.5| , following the 
exposition of our results. 

We make use of a very simple property of very good small-set expanders, namely that most of the 
neighbors of a set of size k only touch this set at one point (see Fact[T]in Subsection 1.3 1. This turns out 
to be an extremely useful property which will bare strong consequences for both the computational 
complexity of CLHs on small-set expanders, as well as for stabilizers whose graphs are small-set 
expanders. 



1.2.1 Approximating CLHs on expanders 

We start by studying the complexity of the approximate version of the CLH problem; we ask whether 
we can bound from above the complexity of CLH if we are allowed a constant error in the minimal 
energy; Specifically, if we allow to throw away a certain constant fraction of the constraints; For that 
matter, we study what seem to be "hardest" class of interaction graphs, namely small set expanders. 

We show that the approximation version of the CLH(k, d) problem becomes "easy" and falls into 
NP. (This is of course more surprising if one believes that the general CLH problem is not in NP; if 
on the other hand one believes CLH is in NP, this can be considered as a step towards this goal.) 

Our first theorem states that: 

Theorem 1 (the approximation of CLH on small set bi-partite expanders is in NP) Let 7(e) = 2kde. Let 
H be an instance of CLH(k, d) for constant k, d whose bi-partite interaction graph has a right degree Dr, 
and is e-small-set expanding, for e < h. Let Ai > A2 > . . . > Xn > be the eigenvalues of H. Then for 
every eigenspace Aj, there exists a state \ipi) such that \ \\H\ipi)\\ — A$| < 7(e) \\H\\, and such that |^) can be 
generated by a constant depth quantum circuit. In particular, the j(e)-approximation problem of CLH (k, d) 
on such e small-set bi-partite expander graphs is in NP. 

For the above theorem to be non-trivial, e must be sufficiently small, so that 7(e) = 2kde is less 
than 1. 
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One might ask whether Theorem [T] is trivially true; we might have allowed to remove enough 
terms so that the graph is disconnected into small components and the problem becomes solvable in 
P, just like what happens in the lattice case. We show that this is not the case: 

Theorem 2 Given e < 1/2, it is NP-hard to approximate CLH(k, d) whose bi-partite interaction graph is e 
small-set expanding, to within a factor 7(e) = 2kde. 

Theorem[l]can be considered as a first step towards proving that the CLH problem lies inside NP; 

Alternatively if one takes the point of view that CLH is not inside NP, and hence that a quantum 
PCP theorem might in fact be proven via showing hardness of approximations of CLHs (as is the 
approach of [37, 38 1), then Theorem [I] puts limitations on such a qPCP. While standard constructions 
of classical PCP use graphs with excellent small-set expansion (see the proof of Theorem |2| and one 
can make these graphs have arbitrarily good small-set expansion (albeit while increasing the degree), 
Theorem [T] implies that the smaller the expansion error of the graphs underlying the CLHs are, the 
weaker the qPCP theorem using these CLHs becomes. The approximation error for which hardness 
is shown is bounded from above by some constant times the expansion error. This contradicts classical 



intution. We discuss this further in the Discussion, Subsection 1.5 



1.2.2 Quantum stabilizer Locally-Testable Codes 

Next, we study the much related topic of stabilizer codes. In particular, we study how stabilizer 
codes with local stabilizers behave in the context of local testability. 

As mentioned above, classical locally testable codes satisfy the following property: Given a word 
which is of relative distance 5 from the code, then if 5 is not then this fact can be detected with some 
constant probability s > by querying a constant number k (hence, locally testable) of coordinates in 
the code; One can consider strong LTC codes in which the probability s is proportional to 5, even for 
sub constant S's, or weak LTC codes in which the probability s is at least a constant given that 5 is 
at least a constant. The essential parameter of LTC codes is thus its robustness, captured roughly by 
how s relates to 5. 

More precisely, we say that a locally testable code with degree Dr (namely, that each qudit is 
examined by Dr constraints) is r(5)-robust if an error on Sn locations violates a at least r{5)Dn5n 
constraints, namely, a fraction r(5) of the maximal number it can possibly violate (See Definitions |§j 
[9] for a rigorous definition of the weight of an error and the robustness for various weights). 

There are two famous classical LTC codes used in the PCP proofs of HZHZZHHJ: the long code and 
Hadamard codes. They exhibit extreme robustness, in the following sense: for any e > 0, there exists 
5 > such that all error patterns of weight at most 5n (for code-length n) are violated by a fraction at 
least 1 — e of their incident (3-local) constraints). 

We would like to study the robustness of quantum error correcting codes; To the best of our 
knowledge, the question of local testability of Quantum error correcting codes was not studied yet. 
The very notion of weight of an error is not very natural in the context of general quantum error 
correcting codes; we leave the general definition to a later version of this paper. For stabilizer codes, 
however, the notion of weight of an error is very natural: Just count the number of non-identity 
Pauli's in the error (essentially, modulo the stabilizer group). For the rigorous definition see[HJ Ro- 
bustness would thus correspond to how many stabilizers will not commute with such an error. 

The robustness of quantum stabilizer codes with local stabilizers seems, on the face of it, to be in- 
herently restricted. It is illuminating to consider in this context the Toric code example 11431 . The Toric 
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Code is defined by a set of 4-local constraints on a lattice of yfn by y/n qubits. It is well known that 
one can consider a chain of errors of length 6(y/n) of qubits, such that the only violated constraints 
will be those two constraints that touch the end qubits of this chain. This already indicates very low 
robustness (r(S) < -^=) for values of 5 of the order of -^=. It is easy to extend the low robustness be- 
havior to words of linear distance from the code, by scattering short chains of errors of length 6(1/ e), 
which are separated from each other by at least 6(1/ s) lattice sites. 

The message of this part of our paper is that quantum stabilizer codes in general, as long as they 
have local stabilizers, exhibit inherent non-trivial (and inherently quantum) upper bounds on their 
robustness. 

Our first result in this context might be viewed as surprising, as once again it poses constraints 
when the underlying interaction is expanding: it turns out that if the underlying graph is a good 
small set bi-partite expander, then the robustness is as low as the expansion error itself, for all errors 
with weight smaller than some constant S. 

Theorem 3 Let C be a stabilizer code, with minimal distance > 1, and a k-local generating set Q c IP, such 
that each audit is examined by Dr generators. Suppose the bi-partite interaction graph of Q is e-small set 
bi-partite expander, for e < 1/2. Then, for all 5 < min{ k s~ D , \dist(C)}, wehave r(6) < 2s. 

In the above dist(C) denotes the distance of the code (see Definition m. Theorem [3] thus provides 
a trade-off between the expansion and the robustness; The better the expansion, the worse the robust- 
ness. This seems like an inherently quantum phenomenon, contrary to what happens in the classical 
world. 

To contrast it with the classical setting, recall a result by Dinur and Kaufmann which shows that a 
robust LTC code must have an interaction graph which is a small-set expander (Theorem 1.1 in [28 1); 
We note that direct comparison does not hold since the definitions of expansions used are different; 
|28] does not use bi-partite graph expansion but rather the graph in which an edge connects any two 
nodes that participate in a common constraint. 

Stronger evidence that Theorem [3] shows a solely quantum phenomenon is given by the con- 
struction of lossless expanders in [24 j. This construction gives classical error correcting codes whose 
robustness is very close to 1. 

Claim 1 For any e G (0, 1/2), and r G (0, 1) there exists a constant 5 = 5(r,s), such that there exists an 
explicit infinite family of codes {C £ (n)} ngN , of n bits, of constant fractional rate r, and constant fractional 
distance d = d(s, r), whose check terms are of locality whose expectation is equal to a constant k, and all errors 
of weight less than 8n have robustness at least 1 — 3s. 

The proof of this claim is given in the appendix. We note that contrasting Claim[l]with Theorem|3] 
is not exact, since the classical codes constructed have only average constant degree and not constant 
degree; we believe this is not an essential point. 

We use theorem [3] together with a rather involved probabilistic argument, to establish an absolute 
non-trivial upper-bound on robustness of stabilizer codes, for errors of size at most some constant 
relative distance. A semi-trivial such bound exists, due to the size of the alphabet: For a given qudit 
of dimension d, the number of possible errors on one qudit is d 2 — 1. Fix a qudit, and pick Q to be the 
Pauli on that qudit which is most popular among all the stabilizers acting on that qudit. Then at least 
l/(d 2 — 1) of the stabilizers on that qudit will commute with that error, and so at most a(d) = 1 — j- 



7 



of the stabilizers touching that qudit will not commute with that error, and thus will detect the error 
(see fact [1] for an exact proof). The robustness is thus bounded by a(d), which we call the single-error 
robustness, or the alphabetical upper bound on the robustness. Classically there is no direct analogue 
to the requirement of non-commutativity to achieve constraint violation, and hence a(d) = 1 in the 
classical case. 

We are interested in a deeper phenomenon; it turns out that for any /c-local stabilizer codes, the 
robustness must be strictly smaller than the single-error robustness. 

Theorem 4 (Roughly) For any stabilizer code C of k-local terms (k > A) over d-dimensional audits, where 
each qudit interacts with Dr local terms, errors of weight at most some constant fraction ofn have robustness 
at most a(d)(l - ^ gap ) for some j gap = 7 gap (A;, d) > 0. 

This indicates some inherent "problem" in the quantum setting when one is interested in maxi- 
mizing the robustness to make the code most 'sensitive" (in terms of energy penalty) to errors; Un- 
derstanding this phenomenon might be tightly related to the clarification of the qPCP conjecture. 

1.2.3 PCPs of Proximity 

A PCP of proximity, or PCPP, is a form of language verification where the verifier receives, in 
addition to the usual NP-witness to the veracity of the claim made by the prover, an auxiliary proof 
that allows for a low-query test on whether or not the witness is "close" to or "far" from the set of 
acceptable witnesses. Ben Sasson et al [13j provided construction of an LTC code given a PCPP, 
and described how the parameters are mapped from one to another, (see Construction 4.3, and 
Proposition 4.4 in [fT3l >. 

We define quantum PCPPs, where the PCPPs must be defined with respect to a given set of 
constraints that can be used. We then show that a similar result to that of IH3H mapping a quantum 
PCPP to an LTC with a corresponding set of constraints, holds also in the quantum setting. Thus, 
limitations on quantum LTC codes translate to limitations on quantum PCPPs using similar sets of 
constraints; providing an important motivation to understand Quantum LTC codes. 

We will delay the definition of quantum PCPP using various sets of constraints, together with 
the general definition of LTCs (which use not only stabilizer constraints) and the above statement 
connecting the two, to the next version of this paper. 

We mention that for now, our bounds on robustness of LTC codes are merely initial indications of 
the difference between the quantum and the classical LTC behavior, and much is left for improvement 
in terms of the parameters; moreover, currently our bounds on the robustness of LTCs hold only for 
stabilizer codes. Thus, they imply rather limited implications on qPCPPs. However, the connection 
between qLTCs and qPCPPs extending the known classical connection between LTCs and PCPPs 
strongly motivates further study of qLTCs, as well as improving our parameters and extending our 
results to other constraints systems; a deeper study of the implications to the qPCP conjecture of this 
direction is called for. 

1.3 Overview of Proofs 

1.3.1 Simple observations on expanders 

Given a bi-partite graph G(R, L : i?), we say a set of nodes in i? is e-expanding if T(S) > Dr\S\(1 — e) 
where r(5) the neighbors of S and Dr the right degree. 
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Two basic observations in this paper are the following; The proofs can be found in the appendix, 
(see [24j for similar observations) 

Fact 1 Consider S C Rin a bi-partite graph G(R, L : E) and let S e-expanding, for e < \. Then a fraction 
at most 2e of all vertices ofT(S) have degree strictly larger than 1 in S. 

Fact 2 Let S C Rin a bi-partite graph G = (R, L; E), such that S is e expanding. Then there exists a vertex 
q G S, such that the fraction of neighbors of q with at least two neighbors in S is at most 2s. 



1.3.2 The complexity of approximating CLH on expanders 

The idea behind the proof of Theorem ([TJl is as follows. Much of our current knowledge on the 
complexity of CLH relies on a critical observation by |18| that any two commuting local terms Hi,Hj 
can be viewed as acting on "disjoint" subsystems, using some basic facts from the representation 



theory of CValgebra. Informally (see Subsection 2.2 for a formal description), the idea is this. We 



consider two terms in the Hamiltonian, Hi and Hj, which intersect on some subset of qudits, whose 
Hilbert space is Hint- Bravyi and Vyalyi's lemma claims that there exists a local isometry on Hint, 
preserved by Hi, Hj, which if applied, the space of the intersection can be written as a direct sum of 
subspaces, and in each one, the two terms are "disconnected" from each other, so that they essentially 
act on different subsystems which are in tensor product. In other words, 

a 

Such that Hi (Hj) restricted to the a subspace acts non trivially only on the left (right) subsystem, 
H.fnl (Hfnt)- This lemma was used by Ifl8l to show that 2-local CLHs (corresponding to graphs) are in 
NP; However as was noted in [3j more is needed in the case of hypergraphs. 

In the context of expanders, we use it as follows. Given a constraint Hi, if we now remove all 
terms that share at least 2 vertices with Hi, (and this, by Claim [T] is just a small portion of the terms 
intersecting that term) we get into a situation in which all terms that intersect Hi, intersect it at only 
one particle. This makes the intersection pattern simple enough, so that Bravyi and Vyalyi's lemma 
[ 18 1 can be applied almost directly on each of the qudits on which the terms acts on. The final result 
is that the term Hi can be separated from the remaining terms and can be viewed (up to the relevant 
isometries) as acting on a separated subsystem. 

How to use this insight to show that the approximation to within a small constant is in NP? It is 
not enough to simply take away, for each term, all terms that make it isolated, as this will require 
removing too many terms. Instead, we use the above idea iteratively. At each iteration we choose a 
local term v and "isolate" it (see definition [7|): we remove as many terms as necessary so that among 
the remaining terms, no local term shares more than one particle with v (see figure |2|. Bravyi and 
Vyalyi's lemma can then be applied, and v can be separated from the rest, after restricting the qudits 
to the relevant subspaces in their direct sum of Equation [I] Now we can continue in the same way, 
starting from the restricted subspace. This way we gradually "tear-away" local subspaces of particles. 

The analysis of the upper bound on the number of terms that need to be removed altogether 
requires some thought, since the number of particles does not necessarily decrease through one it- 
eration; it is only their dimensionality that decreases. We resort to an amortized analysis counting 
the number of dimensions that are removed in total. As far as we know this amortized counting of 



9 



dimensions is novel in the context of quantum Hamiltonian complexity, and may be of interest on its 
own. 

Note that unlike in the lattice case, removing edges here is done not in order to disconnect part 
of a graph, but only to isolate terms; loosely speaking, to make the interaction pattern more sparse. 
Disconnecting entire parts of the graph will require removing too many terms in the context of ex- 
panders, and will thus lead to too large an approximation error. The proof of theorem Q that the 
approximation problem on small-set expanders is NP-hard follows from the observation that the 
output of the PCP amplification routine due to Dinur ([27J) is an excellent small-set expander. 

1.3.3 Bounds on LTC codes on Expanders 

To prove Theorem |3j we argue that a stabilizer code whose underlying interaction graph is a good 
enough bi-partite small-set expander, cannot be too robust. To do this, we define a particular er- 
ror pattern, which has a large weight modulo the stabilizer, but which does not violate too many 
generators. 

The error pattern we define acts on one qubit in each one of a set of "isolated" terms. By "isolated" 
term (formally, L-independent terms - see Definition [ill, we mean something completely different 
than the previously used isolated qudits; a set of terms is L-indepdent if no two terms in it are 
closer than some constant in the interaction graph. Picking one qudit in each term, we claim that the 
weight of this error cannot decrease when multiplied by an element from the group. Intuitively, this 
is because of the following reason; If such an error pattern can be represented more succinctly, there 
must be one single qudit whose error is removed modulo the stabilizer group, and moveover, no new 
errors appear (modulo the group, again) in a constant but large enough neighborhood of that qudit. 
We show that this cannot happen since the stabilizers are too local. 

We need to design an error pattern whose robustness will be limited. By examining the code itself, 
we can "distill" an error which causes a minimal number of violated constraints. Here Fact fallows 
to pick cleverly the qudit in each term on which the error will act, and also to define what Pauli error 
will act on it to minimize the penalty (namely, the number of generators which will not commute 
with the error). For a term g we choose the qudit q to be the one promised by the lemma: a qudit s.t. 
a vast majority of the terms acting on it intersects g at only one location. We define the error on q to 
be the restriction of g to q; since all stabilizer terms commute with g, those that intersect g only on q 
must agree with it on q. It follows that most of the incident generators on q will commute with this 
error, and only a meager fraction of its incident generators, will realize that this is indeed an error. 

1.3.4 Upper bound on robustness 

Our final theorem states that for any constants k > 4, d, there exists a constant less than 1, upper- 
bounding the robustness of any quantum LTC of /c-local constraints, on <i-dimension particles. Our 
proof relies on bounding the robustness of a quantum LTC from two sides. On one hand, we use the 
bound of theorem |3]l which is, in fact, the "surprising" side, which implies that high expansion forces 
low robustness. We then add a new claim showing that quantum Stabilizers, not only suffer from the 
quantum effect of <|3j> but also, cannot avoid, the "classical" effect that codes with poor expansion 
have low robustness. 

We restrict our attention to sets of qudits belonging to generators which are "far" away from each 
other in the interaction graph of the generating set. Given a set of qudit "islands" with poor collective 
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expansion, we try to find an error on this set which has less-than-optimal number of violations. At 
least intuitively, a set with poor expansion, cannot have full robustness, since if "all" bits of the set 
are erroneous there are less than an optimal number of constraints examining this set, so there would 
be less-than-optimal number of violations. However, this intuition on its own is insufficient, since we 
don't know whether or not we can find an error whose weight will be the entire set. Rather, we resort 
to using a random error, so that only a small fraction of the set is erred. We show, as a sub-claim 
that on average, even a random error which is "sparse" on the set, will still sense the fact that the 
complete set has sub-optimal expansion, and would yield less than optimal number of violations. 

The fact that the resulting error has large weight modulo the centralizer follows from an obser- 
vation we prove, that each "island" of qudits cannot have its errors "erased" via a more succinct 
representation, if most of the "island" is uninhabited, i.e. less than 1/2 of the qudits are erred. We 
then have a fine trade-off: on one hand, we would like the number of errors on a given "island" to be 
smaller than 1/2, and on the other hand, we would like a good portion of "islands" to have at least 2 
errors, so that they "sense" the sub-optimal expansion. 

1.4 Comparison with prior work 

The question of approximating the minimal energy of local Hamiltonians was considered by various 
researchers; see Bansai, Bravyi, Terhal flT], and Kempe and Gharibian ( 11331 ), who gave upper bounds 
on non-trivial approximation factors for general local Hamiltonians. 

The approximation of commuting local Hamiltonians, and the PCP conjecture in general, was the 
motivation of Hasting's work [37] in which he showed that certain classes of CLHs lie in NP (without 
approximation). Arad [6] also considered the commuting case as a base for perturbations in his 
partial no-go for quantum PCP result. Hastings and Freedman f38| recently defined generalization of 
expanders to hypergraphs, motivated by the attempt to prove the quantum PCP conjecture. We note 
that the graphs designed in [38 1 are small-set expanders to which our theorems, and in particular 
Theorem [l] apply; hence, our work puts limitations on the strength of quantum PCPs using such 
graphs. 

In a recent independent result, Brandao and Harrow [17] have shown that the approximation of 
2-local Hamiltonians on expanding graphs (here expanding in the standard definition) lies in NP, 
with an error depending on the second eigenvalue of the interaction graph. This is a complementary 
result to our theorem [lj since on one hand, there is no commutation requirement in [17], but on the 
other hand they only handle the case of graphs, while higher locality might be crucial in the context 
of the problems studied here. In particular, it is unclear whether it is possible to derive a result about 
approximating /c-local Hamiltonians on expanders from the results of [17], since the gadgets allowing 
to move from k— to 2-local ||22|| change the topology of the graph. 

We note that our Theorem jl} reduces in 2-local case to a error approximation, namely an exact 
verification procedure; in other words, it reduces to the result of ([18]). This is because bi-partite 
expansion is essentially maximal for any 2-local CLH, since in this case two different constraints 
cannot intersect on more than on qudit. This is another indication that at least for the CLH case, bi- 
partite expansion (Definition ^) seems to be the appropriate one to use, compared to that of regular 
expansion, which is used by [17] for the general LH case. 

As for quantum error-correcting codes, quantum LDPC (Low Density Parity Check) codes, namely 
codes with local check terms, were already studied in the literature (see ||58l |59| and references 
therein, as well as [46. 47]). However, as mentioned before, we are not aware of any prior work 
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on quantum locally-testable codes. 
1.5 Discussion 

Complexity of CLH One might hope that Theorem [T] could be extended to show that the approxi- 
mation of the CLH problem on a general topology is in NP, perhaps by bridging between our results 
on expanders to the easy case of approximation on lattices. We note that a hint about the difficulty of 
such a result comes from the status of the Unique-Game-Conjecture [41 j which is known to be easy 
on both cases (albeit for interaction graphs and not hypergraphs), though conjectured to be iVP-hard 
in general. Still, it may be possible to achieve some weaker approximation of general graph using 
"bridging" between the case of lattices and expanders, perhaps by sub-exponential witnesses, fol- 
lowing the work of [55],110J. We note here that the "bridging" that we did achieve for stabilizer code 
in Theorem (Q, indeed depends on these instances being more structured, and as such, does not fol- 
low through for general CLH instances. It thus remains an important open problem to generalize our 
results to all interaction graphs. Of course, clarifying the exact case remains a major open problem. 

Quantum PCP and quantum LTCs Though one cannot derive using Theorem jl} a bound for gen- 
eral PCP, it does place severe restrictions on any commutative version of a quantum PCP: i.e. a 
poly-time algorithm taking any instance of LH (or even just CLH), to a CLH instance with constant 
promise gap. Specifically, assuming CLH is not contained in NP, our results indicate that the output 
of such a quantum PCP is unlikely to assume the form of a bi-partite small-set expander, unlike in 
the classical PCP proofs. First, Theorem [I] implies that for a given expansion error e, the promise gap 
must be of the order of e which can be a very small constant. Moreover, one may speculate that if the 
output of such a PCP routine, has some small expansion error, than this error may be set arbitrarily 
low. This would imply that as e goes to 0, the promise gap goes to 0, contradicting the existence of 
such PCPs. 

We note that to the best of our knowledge, the question of general upper bounds on robustness 
of quantum LTCs was not considered before, though of course robustness of specific quantum codes 
is very well understood; interestingly, the prominent example of the Toric codes has inherently small 
robustness, which is tightly related to the fact that the code exhibits topological order, and thus only 
the "end points" of an error matter |42[ . Quantum error correcting codes can be viewed as a general- 
ized topological order (see |37| ), and perhaps some bounds on robustness phenomena can be carried 
over to all codes, not necessarily stabilizer LTCs as in our Theorem|4j perhaps by using the fact that 
the code has large distance; It will be very interesting to derive such a result. Also, it will be most 
interesting to come up with explicit (or even non-explicit) constructions of quantum codes with very 
good robustness. 

Of course, strengthening of our results in various other directions are called for: be it generalizing 
to all weights of errors, to various types of constraints, and of course, removing the commuting 
requirement. 

In a later version we will define Quantum PCPP; and make explicit the connection between quan- 
tum PCPP and quantum LTCs. In particular, this implies that the restrictions on LTC codes with 
various types of constraints lead to bounds on PCPPs using similar constraints. The results we have 
presented here |3]l and provide unexpected limitation on stabilizer LTC codes. The connection to 
quantum PCPP strongly motivates extensions and further clarifications of our results on qLTCs and 
their implications to qPCPs. 
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Finally, we believe the results we presented here hint that possibly, the problem of CLH and clar- 
ification of the importance of the commutation relations, might be more relevant to the resolution of 
the quantum PCP conjecture than was thought before. For example, if the qPCP conjecture were true, 
and the method of proof was indeed through a Quantum PCPP, and if indeed CLH is not Quantum 
NP hard (all of the above conjectures might seem quite reasonable to believe in at this point), then this 
must imply the existence of novel excellent qLTC codes whose local check terms are non-commuting, 
by which such a qPCP theorem would be proven. Can such codes exist? Studying this question 
directly can shed light on the likelihood of the above mentioned conjectures to be true. 



Organization of paper 

In Section|2]we provide the background. Section 3.1 proves theorem [lj showing that approxima- 
tion of CLH on expanders lies in NP. Section [3T2| proves Theorem |2j showing that the approximation 
problem we handle is NP-hard. Section [4] provides bounds on the robustness of quantum LTC codes 
on expanders, and Section [5] provides an absolute bound on robustness of stabilizer LTC codes re- 
gardless of the expansion of their underlying graph. 



2 Background 

A (k, (i)-local Hamiltonian on n qudits is a Hermitian matrix H = ^ Hi operating on a Hilbert space 
% = Qd® n Q £ n ^-dimensional particles, where we assume for all i, \\Hi\\ = 1 and Hi = hi® I n -k is 
Hermitian operating non-trivially only on k particles. 

Definition 1 The commuting local Hamiltonian problem In the (k, d)-local Hamiltonian problem on n 
d-dimensional qudits we are given a (k, d)-local Hamiltonian and two constants a,b, a — b = Q f ^^j j • We 
are asked to decide whether the lowest eigenvalue of H is at least b or at most a, and we are promised that one 
of the two occurs. In the commuting case, we are guaranteed that [Hi, Hj] = Ofor all i, j, and W.L.O.G, we 
also assume that Hi's are projections, a and b can be taken to be and 1 in this case, respectively. 

2.1 Interaction graphs and their expansion 

One can consider various definitions for the interactions graphs underlying a local Hamiltonian. 

Definition 2 Bi-Partite Interaction Graph For a (k,d)-local Hamiltonian H = {Hi} i we define the bi- 
partite interaction graph G = (L, R; E) as follows: R, the nodes on the right, correspond to the n particles of 
% = C d ® n and L corresponds to the set of local terms {Hi}^ An edge exists between a constraint I e L and a 
particle r e Rif H\ acts non-trivially {namely, not as the identity) on r. Note that the left degree is equal to k; 
We denote the right degree to be Dr. 

Definition 3 Bi-partite small-set expansion A bi-partite graph G = (L, R; E) is said to be e-small-set- 
expanding, if for every subset of particles S C R of size \S\ < k, \T(S)\ > \S\Dr(1 — e). 

Bi-partite expanders have been defined and used e.g., in [52] , ||24| to construct locally-testable 
classical codes. Here we require expansion to hold only for small sets. 
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2.2 Commuting terms and C* -algebras 

We now state the lemma of Bravyi and Vyalyi l[T8l precisely: 

Lemma 1 Let Hi, Hj be two local terms on Hilbert space %, [Hi, Hj] = 0. Let Hint denote the intersection of 
supp(Hi) n supp(Hj), where supp(H) is the subset of audits examined non-trivially by H. Then, there exists 
a direct-sum decomposition 

Hint = Hfnti 



where for each a we have: 



n int — n int ^ n int ' 



such that both Hi, Hj preserve all subspaces %f nt , and moreover, for each a Hi\ a is non-trivial only on the 
Hilbert space H^v whereas Hj\ a is non-trivial only on the Hilbert space 



int ' 



^ R) ^ (« 
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Figure 1: An example of lemma (JT): a pair of 2-local Hamiltonians, are restricted to a subspace a on 
their intersection. Inside this subspace, they act on separate subsystems. 

In this paper we apply Lemma (JTJ in the following context: 

Corollary 1 Let H be a CLH(k, d) instance, and let Ho be a local term such that for any Hi e H\ {Hq} that 
intersects Hq, the intersection is at most on one qudit. Then there exists a direct-sum decomposition, on each of 
the audits of Hq, preserved by all local terms of H, such that the restriction of Hq, to any such tensor-product 
subspace, is disjoint from any other term in H. 

Proof: For each particle q examined by Hq, let the term Hi be the sum of all local terms acting on q 
except Hq, and apply the lemma one by one on each qudit this way. ■ 

Note, that the above corollary does not require that any two local terms acting on a qudit in Hq, 
intersect only on that qudit. 



2.3 stabilizer quantum error correcting codes 

Definition 4 stabilizer Code The group LT n is the n-fold tensor product ofPauli operators A\ ® A2 <8> . . . ® 

A n , where Ai E {I, X, Y, Z}. along with multiplicative factors ±1, ±i with matrix multiplication as group 
operation. A stabilizer code C is defined by a set of commuting elements in IP; the set is denoted by Q. The 
group generated by Q is an Abelian group denoted A C H n . The codespace is defined as the mutual 1-eigenspace 
of all elements in A (alternatively, in Q). An element of £ G LT n is said to be an error if it does not commute 
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with at least one element ofQ. i.e. £ £ Z(A), where Z(A) is the centralizer of A. An element of £ £ IP is said 
to be a logical operation, if it commutes with all ofQ, but not generated by Q, i.e., £ £ Z(A) — A. A stabilizer 
code is said to be k-local if each term g £ Q is a tensor product of n Pauli operators in which exactly k are 
different than I. 

The Pauli group can be generalized to particles of any dimensionality, and thus the above defini- 
tion can be generalized to work over any dimension d: 

Definition 5 The Pauli group generalized to Zd Let X\ : \%) i->- \i + k modulo d),P^\j) H> \j) be the 
generalized bit and phase flip operators on the d-dimensional Hilbert space, where Wd is the primitive dth root 
of unity. Let lid be the group generated by those operators (and the necessary multiplicative factors, namely, 
all roots of unity of order d.) The group U™[ is the n-fold tensor product of Pauli operators A\ ® A2 <8> . . . ® A n , 
where A{ £ {X^P^) along with the multiplicative factors. 

The definitions |4] can be generalized to any dimensionality of particles d. We can now define the 
distance of the code: 

Definition 6 Distance Let C be a k-local stabilizer code with generating set Q C IP. For an error £ £ IP, 
let wt(£) denote the size of the non-trivial support of £, and let wt(£g) denote its minimal weight modulo the 
group A generated by Q, C is said to have a constant relative distance 5 > 0, if for any £ £ Z(A) — A, we have 
wt(£g) > 5n. 

We note that a code with distance 1 cannot correct any error (see [34 j) and so we can assume the 
absolute distance is strictly larger than 1. We also note that we can assume that there is no qudit q and 
a state on it |a)such that all states in the code look like |a) tensor with some state on the remaining 
qudits; We say that in this case, the qudit is trivial for the code. 

2.4 Notation 

Throughout the paper we shall use the following notation: d is the dimension of the qudits involved. 
For a bi-partite graph we denote G = (L, R; E) where L denotes the left set of vertices of size \L\ = m 
(corresponding to constraints in the text), R denotes the right vertices \R\ = n (corresponding to 
particles), and E is the set of edges between L and R. D will denote the degree of a graph in more 
generality; Dr will denote the right degree of a Bi-partite graph, which is assumed in this paper to 
be constant. 

Given S C R(L) in a bi-partite graph, T(S) denotes the neighbor set of S in L(R). Af(q) will 
denote the neighborhood of q in R, namely all the qudits participating in all the constraints acting 
on q. e (and sometimes fi) will be used to denote the expansion error for bi-partite graphs (as in 
Definition pj. 5 will be used to denote the relative distance of a code. 7 will be used to denote the 
promise gap, or alternatively the approximation error of a CLH instance, i.e. the fraction of terms 
we are allowed to throw away. 

3 Approximate CLH 

3.1 Approximating CLH on Expanders 

We can now prove Theorem |T]). As mentioned in the introduction, the proof relies on the simple 
important observation regarding highly expanding small set bi-partite expanders, namely, that not 
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too many terms intersect a term in more than one node (ClaimjTj). We start by proving the following: 

Proof: (Of Claim [T]) By definition, and by the requirement on expansion, the average degree of a 
vertex in T(S) w.r.t. S is m?m < jh^ — 1 + 2e, where the second inequality follows from e < \. Since 
each vertex in T(S) has degree w.r.t. S at least 1, the claim follows. ■ 

We now define a notion of isolation, which will help us handle single constraints: 

Definition 7 Isolated constraints and particles Let(L, R; E) be a bi-partite graph. A constraint g e L is 
isolated if for any constraint v G L except g, we have \T(v) n Tg\ < 1. We define the isolation penalty of g, 
to be the minimal number of constraints in L that we need to remove so that g is isolated. 

We are now ready to prove the theorem: 

Proof: (Of Theorem]!} Let H be an instance of CLH(k, d), and let (L, R; E) be its bi-partite interaction 
graph, where the degree of each v € R is Dr. We perform an iterative process. At step t, we have a set 
of remaining terms L rem (t) acting on the remaining Hilbert space T-L r em(t)- We also have a set Lb a d(t) 
which are terms we have collected so far that we want to throw away. W.l.o.g., we shall find a state 
whose energy approximates the ground energy of H, but this can be applied to the approximation of 
any eigenspace. Repeat the following: 

1. isolate Pick an arbitrary local term v in L rem (t). and isolate it (Definition [7} by removing as few 
as possible terms from L (putting them in a set of terms which we call L^ a( i{t)). 

2. isometries Now that the term is isolated, the conditions of Corollary [T] hold: By the corollary, 
there is a tensor product of 1-local isometries on the qudits of v: W v = Wi that is contained 
in the zero eigenspace of L rem (t), such that after applying these isometries, the term v acts on 
a disjoint subsystem than the rest of L rem (t). We conjugate v, and each term of L rem (t) by W v . 
We then remove any triviality we encounter, be it removing qudits from Hamiltonian terms or 
entire terms altogether. We call this Pruning. 

3. update We set L rem (t + 1) as the set of remaining local terms of L rem (t) after this pruning, and 
then update % r em{t + 1) as the support of L rem (t + 1). We set L goo d{t) to contain v (t) restricted 
to the subspaces of the qudits, as in Corollary [TJ 

We terminate when there is no longer any intersection between two different terms of L rem (t). 
Clearly, this ends after at most polynomially many iterations, since the number of terms in L rem (t) 
decreases by at least 1 each iteration. Let the number of iterations be T. We claim that a state ap- 
proximating the ground energy of the original Hamiltonian to within \Lb a d{T)\, can be recovered from 
this procedure by finding the ground state of all terms in L goo( i{T), and applying the inverse of the 
isometries applied along the way, which amounts to applying a constant-depth quantum circuit. This 
is true as long as the subspaces in the direct sum that were chosen contained the ground state of the 
current Hamiltonian; the NP prover can provide the indices of the subspaces so that this holds. 

Bounding the approximation error The non-trivial part of the proof is to upper bound \Lb a( i(T)\. 

Let us measure the following ratio at each iteration t: the number of local terms moved to Lb a d(t) 
during step "Isolate", divided by the overall particle dimension (namely, sum of local dimensions of 
particles) which we reduced. We claim that this ratio is at most 2Dre, and so 
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Local Terms 



Quantum Qudits 




Qudits removed to "Hgoodit) after isolation of T(v t ) Qudits that are restricted to a non-trivial subspace of 'Hrem{t)- 

Figure 2: The isolation procedure: after removing the local terms to L& a d/ vt becomes isolated. We 
then apply local isometries to each of its qudits in T(vt). One of the qudits is exclusively examined 
by vt after isolation, so it is removed altogether to % g0 od- 

Claim 2 We remove at most 2Dre terms per local dimension we remove. 

Proof: To see this, consider a term v(t) in L rem (t) whose support is a set S with a vertices. Let G(t) 
denote the bi-partite interaction graph of L rem (t). We know that in G(0), it was true that \T(S)\ > 
aDn(l — e), and so in order to isolate S, it sufficed to remove 2eDna vertices. Since G(t) is derived 
from G(0) by removing vertices and edges, this bound still holds. So at each step, when isolating a 
term of size a, we remove at most 2eDjia constraints. 

On the other hand, let us calculate how many qudit dimensions we remove at such an iteration, 
out of the total number of qudit dimensions (namely, the sum of dimensions over the particles). For 
each qudit q G S, q is either removed altogether, and thus its local dimension is reduced by dim{% q ), 
or it is restricted to some non-trivial subspace and maybe further divided to two sub-particles, one 
of which is removed from % rem (i); this act reduces the local dimension by at least 1. Thus, the total 
number of local dimensions removed by one application of "isolate" is at least \S\ = a. m 

The initial total sum of particle dimensions is d\R\. By the claim, \Lh a ^(T)\ < 2Drs ■ (ci|i?|). 
Substituting D R = k\L\/\R\, we have that \L bad {T)\ < 2ked\L\, or |L "^{ T)I < 2kde, as desired. ■ 

3.2 NP-hardness of approximation 

The proof of theorem [2] relies on the fact that the output of the PCP reductions in Dinur's proof [27] 
are excellent small set Bi-partite expanders. The gap can be amplified to, say, a 1/3, and yet the 
expansion error e can be made smaller than any constant, and certainly smaller than the required 
7(e). This is an easy observation given the proof in §27\ and we leave the details of this for the journal 
version. 
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4 Bound on the Robustness of stabilizer LTCs on Expanders 



In this section we define stabilizer LTC codes and their robustness, and prove Theorem [3] 
4.1 Definitions: stabilizer LTC codes 

Definition 8 The weight of an error on stabilizer codes Let C be a stabilizer code on n audits, with 
generating set Q c Tl n . Let A be the associated stabilizer group. Let £ G W 1 be some element in the Pauli 
group. We denote by wt(£) the number of locations in which £ is non-identity. We denote by wtg(£) the 
weight of £ modulo the group generated by Q, i.e., the minimum over the weight of all words which are equal to 
£ modulo an element in the group A generated by Q; Likewise, we denote by wtzig) {£) the weight of £ modulo 
Z(A), the centralizer of A, the group generated by Q. 

We now define the robustness of a stabilizer code. 

Definition 9 Robust Local stabilizer Codes Let C be a stabilizer code, with generating set Q c W 1 , such 
that each particle is examined by Dr generators. C is said to be r(5)-robust, if for any £ G IP such that 
wtz(g)(£) = Sn, we have that £ does not commute with at least r(S) ■ Dr ■ wt z ^(£) generators g G Q (we 
say that those generators, namely constraints, are violated). We call r($) the robustness of the code for errors of 
size 5. We sometimes refer to the robustness of a given error pattern £ asr if the number of violated constraints 
for that error pattern is at least r ■ Dr ■ wtz(g)(£). 



4.2 A useful fact about stabilizers 

Definition 10 Restriction of stabilizers For a Pauli operator A, let A\ q denote the q-th component of the 
tensor product A, and let A\- q denote the tensor product of all terms except the q-th. Similarly, for a generating 
set Q, we denote by Q\ q as the set {g\ q \g G Q}, and similarly for Q\- q . 

We now prove a useful fact: that the restrictions to a given qudit q of all the generators of a 
stabilizer code with distance larger than 1 cannot all commute. 

Fact 3 Let C be a stabilizer code with minimal distance at least 2. Then for any qudit q, there exist two 
generators g(q),h(q) acting non-trivially on q such that [g\ q , g'\ q ] / 0. 

Proof: Otherwise there is a qudit q such that for any a,b G Q we have [a\ q , b\ q ] = 0. Let Q = g\ q for 
some g G Q s.t. Q is not the identity. We have that Q' = Q (g> namely the tensor product with 
identity on the other qubits, commutes with all g G Q, and thus is in the centralizer of Q: Q' G Z(Q). 
However, Q' cannot be insider the stabilizer, since otherwise q is in a constant state (the 1 eigenvector 



of Q) for all words in the code, and is thus trivial for the code (see Section 2.3 1. Hence, Q' G Z{A) — A, 



where A is the stabilizer group and Z(A) its centralizer, and so the distance of the code is 1. 



4.3 Proof of Theorem g] 

In the proof we will make use of "sparse" sets of constraints, defined as follows. 

Definition 11 L-independent set of constraints The neighborhood of a constraint is all constraints which 
intersect it in at least one qudit. A set of constraints U C L is said to be L-independent if for any two 
constraints in the set, their two neighborhoods do not intersect on any qudit. 

Proof: (Of theorem [3} 
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Generating the error We want to construct an error with large weight modulo the centralizer that 
will not violate too many constraints in Q. Let C be a stabilizer code with a A;-local generating set 
Q, such that the bi-partite interaction graph of S is a small-set bi-partite e-expander. Let U be an 
L-independent set of constraints of size Sri. We note that since 5 < k 3 1 DR an L-independent set of 
this size must exist, by a simple greedy algorithm. For a given u G U, and i G [k], let cti(u) denote 
the number of check terms incident on qudit i of T(u) that have at least two representatives in T(u). 
Then for each u we define q(u) to be the qudit of minimal cti(u) over [k]. Let T = {q(u)\u G U}. Let 
us define an error pattern: 

We first note that £ is not inside the centralizer C(Q), and therefore it is an error; This is true since 
by fact |3j for each qudit q in the support of £, £\ q does not commute with h\ q for some h G Q. But 
since T is induced by an L-independent set, h does not touch any other qudit in the support of £ 
except q, so this implies [h, £} = [h\ q ,£\ q ] ^ 0. We will now show that £ has large weight modulo the 
group, but is penalized by a relatively small fraction of the check terms. 

Weight Analysis By definition, we have that wt(£ ) = \T\ = \U\ = 5n. We need to show 

wt c(g) (£) = \T\ (2) 

Since 5 was chosen to be smaller than half the distance of the code C, wtz(g)(£) = wtg(£) and so it 
suffices to argue about the weight of £ modulo Q. 

Suppose on the negative that wtg(£) <\T\. Let £' be an error pattern which is equal to £ modulo 
Q but has weight < \T\. In other words, let A G S be a word in the group S s.t. A£ = £'. Since the 
weight of £' is strictly smaller than that of £, there must be one qudit qo in T, s.t. on the neighborhood 
M(qo) the weight of £' is strictly smaller than that of £, which is 1; namely, £' must be equal to the 
identity on all the neighborhood of qo. Here, we have used here the fact that the neighborhoods of 
different qudits in an L— independent set are non-intersecting (definitionJTTJ. This means that A must 
be equal to the inverse of £ on this neighborhood. But this inverse is exactly the following: It is equal 
to £ I" 1 on qo, and to the identity on all other qudits in the neighborhood; and moreover, we have 
by construction that S\~^ on qo, (and therefore also that £\ qo ) does not commute with h\ qo , for some 
h G Q.) This means that A does not commute with h G Q, in contradiction to the fact that A G S. 

Robustness Analysis We upper-bound the number of generators that do not commute with £ . For 
each u G U , we have that the number of generators g G Q that do not commute with <f | 9 ( n ), is at most 
the number of generators that share at least two qudits with u. By fact ^ there exists a qudit such 
that the fraction of its check terms with at least two qudits in supp(u) is at most 2s. Since we chose 
q(u) to be the qudit that minimizes that fraction over all qudits of u, the absolute number of such 
check terms is at most 2eDr. Hence the overall penalty on £ is at most 2e\T\Dr. By Equation[2]we 
get that the penalty is at most 2eDjiwt(£g). By definition|9j this implies that r(5) = r(wt(£g) /n) < 2e. 
■ 

Corollary 2 Let C be a stabilizer code of minimal distance > 1 and a k-local succinct generating set, such 
that each qubit is examined by Dr constraints. If there exists an L-independent set U, s.t. \U\ = bnfor some 
5 > 0, and U's neighbor set of qudits has expansion error at most e (i.e. \T(T(U))\ > \T(U)\Dr(1 — e)), then 
for any 5' < 5 we have that r(5') < 2e. 
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Proof: The proof follows exactly the proof of Theorem[3]noticing that the only thing we need from the 
assumption on the expansion of the graph, is the existence of an L-independent set whose expansion 
errors is at most e. m 



5 An upper-bound on robustness 

We now show an absolute constant, upper-bounding the robustness of any quantum stabilizer code 
C with local generators. We start with an easy alphabet based upper bound. 

5.1 Alphabet-based bound on robustness 

In attempting to understand robustness of a stabilizer code, one must first account for limitations on 
robustness that seem almost trivial, and occur even when there is just a single error: 

Definition 12 Single error robustness Let f(d) = d 2 be the number of distinct generalized Pauli's on a 
Hilbert space of dimension d. Let t(d) = l/(f(d) — 1); The single error robustness in dimension d is defined 
to be a{d) = 1 - t(d). 

The motivation for the above definition is as follows. For any qudit q, there always exists Q, a 
non-identity Pauli operator among the d 2 — 1 Pauli's on a ci-dimensional qudit, such that a fraction at 
least t(d) of the generators touching q are equal to Q when restricted to q. If we consider a one qudit 
error on q to be equal to Q, then it would commute with t(d) of the generators touching q; and can at 
most violate a(d) of the constraints touching it. Thus, one can expect that it is possible to construct 
an error of linear weight, whose robustness is bounded by the single error robustness, using qubits 
whose neighborhood sets of constraints are far from each other. Indeed, we show: 

Fact 4 Alphabet bound on robustness 

For any stabilizer code C on n d-dimensional audits, of distance at least 2, and a k-local succinct generating 
set Q, whose right-degree is Dr, we have r(5) < a(d),for any 5 < l/(k 3 Dn). 

Proof: Similar to theorem ^ there exists an L-independent set U of size Sn. For each net/ we select 
some qubit q G T(u) and examine the stabilizer component on q of all stabilizers on q. Consider P(q), 
the restriction of all generators incident on q to the qudit q, and let MAJ(q) denote the Pauli that 
appears a maximal number of times in P(q). We then set £ = <S) ueU MAJ(q). We first realize that 
£ is an error: we want to show that there exists a generator g such that £ and g do not commute. 
Otherwise, £ commutes with all generators. This implies that for all q, P(q) consists of a single 
Pauli, contradictory to fact (j3j). Similar to equation (|2j of theorem ^ the weight of £ is \U\ = Sn. 
Furthermore, for each qudit q, the fraction of generators on q, whose restriction to q does not commute 
with £\ q is at most a{d), since the number of appearances of £\ q = MAJ(q) in P(q) is at least t = 1— a. 
Hence the number of violated constraints is at most a(d) ■ \U\ ■ Dr. m 

5.2 Separation from alphabet-based robustness 

In this section we show that this alphabet-based bound in fact cannot be achieved, and the robustness 
is further bounded and attenuated by a constant factor below the single qudit robustness, due to what 
seems to be a strictly quantum phenomenon. We will use the topology of the underlying graph to 



20 



achieve this separation, by treating differently expanding instances and non-expanding instances. 
Before stating the main theorem of this section, we require a new definition, and a simple fact: 

Definition 13 k-independent set of constraints Let H be a k-local Hamiltonian instance, and let ube a 
constraint of H. The 0-th neighborhood of u, denoted T(°\u) = T(u) is the set of audits examined by u. 
We define recursively, the t-th neighborhood of u, T'(u) to be the set of audits, belonging to all constraints 
which act on audits in V^~ x ^(u). A set of constraints is said to be k-independent if for any a,b G U we have 

r(*)(«)nr(*)(o) = 

The following fact can be easily derived by a greedy algorithm: 

Fact 5 Letn(k,D R ) = k-( 2k+ VD R {2k ~ 1] . For any k-local Hamiltonian H onn audits, such that each audit 
is examined by Dr local terms, there exists a k-independent set of size at least rjn. 

Proof: Pick a constraint, remove all constraints in its r( 2fc ) neighborhood, and repeat. We get that the 
fraction of constraints is at least /c~( 2fc ) • D R , and by the fact that the number of constraints times 
k, is equal to tiDr, we get the desired result. ■ 

Theorem |1| Let Cbea stabilizer code on n d-dimensional audits, of minimal distance at least k, and a k-local 
(k > 4) succinct generating set Q c IP, where the right degree of the interaction graph ofQ is Dr. Then there 
exists a function j gap = ■y gap (k) > min {lCT 3 , 0.01/fc} such that for any 5 < mm{dist(C)/2,n/10}, we 
have r(tf') < a{d) (1 - ~i gap ). where 5' G (0.995, 1.015). 

The proof of the theorem will use, on one hand, corollary ^ which upper-bounds the robustness 
of expanding instances, and on the other hand a lemma on non-expanding instances, which essen- 
tially, tries to "mimic" the behavior of the classical setting, in which non-expanding topologies suffer 
from poor robustness. We now state this lemma: 

Lemma 2 Let C be a stabilizer code on n audits of dimension d, with minimal distance at least k and a 
k-local (k > 4) succinct generating set Q, where the right degree of the interaction graph of Q is Dr. Let 
Igap = Jgap(k) = min { 10~ 3 , 0.01/fc}. If there exists a k-independent set U of size \U\ = 5n, with 5 < 
mm{dist(C) /2}, such that the bi-partite expansion error ofT(U) is at least e = 0.32, i.e. \T{T{U))\ = 
\T(U)\D R (1 - e')for some ef > 0.32 then 

r(5') < a(d) ■ (1 - -f gap ), 

for some 5' £ 0.1(0.995, 1.015). 

From this lemma, it is easy to show theorem (ffl: 

Proof: (of theorem [4]) The parameters of the theorem allow us to apply directly fact hence there 
exists a ^-independent set S of size at least -on, for n as defined in fact<[5]). Hence, since 5 < 77/IO there 
exists a /c-independent set S of size 105. Now, either: 

1. S has expansion error at least 0.32. By lemma ([2]), for any k > 4 we have 

r(fi) < a(d)(l-j gap ), 

for some u G 0.1(0.99 • 105, 1.01 • 105) = (0.995, 1.015), and ~f gap (k) from lemma (g, which is at 
least min {l0- 3 ,0.01//c}. 
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2. The set S is e-expanding for e < 0.32. In which case, since S is in particular L-independent, 
then by corollary |2), the robustness r(fl') < 2e < 2/3 - 0.01 < a(d) - 0.01, for all 8' < \S\/n. In 
particular r(n) < a(l — 0.01/A;). 

Taking the higher of these two bounds we get the desired upper-bound for r( / u). ■ 

5.3 Proof of the lemma (|2) 
5.3.1 General structure of proof 

Let us clarify what we're trying to show. We want to show that if the expansion is bad, errors cannot 
have large relative penalties. Consider a set S with positive expansion error e > 0. A-priori, if we 
have an error on S, then the maximal number of violations is strictly less than \S\Dr, and in fact at 
most |5|L>k(1 — e). This might seem as though it proves the lemma trivially. 

The technical problem here, however, is that an error on S may just "seem" to be large, whereas 
possibly, may be represented much more succinctly modulo the stabilizer group. We would hence 
like to devise an error pattern, that cannot be downsized significantly, but would still "sense" the 
non-expanding nature of S, and hence have fewer-than-optimal violations. We start with a fact lower- 
bounding the weight modulo the group of an error confined to the qudits of a single generator; we 
call this the Onion fact since its proof (given in Subsection 5.3.4| | works via some hybrid argument on 



the onion-like layers (u) surrounding the qudits of one term u. 
Fact 6 Onion fact 

Let Cbea stabilizer code on n audits with a succinct generating set Q of locality k, such that dist(C) > k. Let £ 
be some word in IT 1 s.t. supp(£) C T^°\u) = T(u)for some generator u G Q. Finally let A G C be some word 
in the code and let £g = AS. Then, for any i e [k], if wt(£ |r(u)) =i,then wt(£g\ V (k)^) > min{i,k — i}. 

Now, let us see what the Onion fact means. It states that given an error on the fc-qudit support of 
a generator, the weight of any representation of this error modulo the centralizer, cannot be reduced 
in the /^-neighborhood of the generator, provided that the error has weight at most k/2. 

Our idea is to concentrate the error on a large set of such "islands", each island supported on one 
generator, s.t. the generators supporting those islands are sufficiently far away from each other (in 
the interaction graph) so that the ^-neighborhoods of those generators are non-intersecting. 

If we draw a random error on the qudits on these "islands", such that the expected number of 
errors per "island", is say 1 error, the following will occur: on one hand, there will be a good portion 
of "islands" with at least two errors, and these two errors will "sense" the sub-optimality of number 
of neighbors due to the expansion, interfere with each other, and cause an overall reduced penalty of 
that "island". On the other hand, only a meager fraction, exponentially small in k, of those "islands" 
with at least two errors, will have more than k/2 errors; only those, by the Onion fact (fact [6]) can 
reduce their weight modulo the centralizer. 

We calibrate our parameters in the random choice of our error pattern to have expected number 
of errors which is indeed order of 1, so that the above tradeoff will indeed hold. 

In the following we first define the error; We provide the proof that the expected penalty of this 
error is small in fact j7j|, then prove the onion fact in Subsubsection 5.3.4 and using it we then prove 



Fact (|8j), in which we show that the error has large weight modulo the group. Finally we combine all 
the above to finish the proof of the lemma. 
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5.3.2 Constructing the error 



Let U C L be a /^-independent set as promised by the conditions of the lemma. Then \U\ = 5n, and 
denoting S = T(U), we have that \S\ = 5nk. Therefore, \T{S)\ = \S\D R (1 - e'), for some e' > 0.32. Let 
£ be the following random error process: for each qudit of S independently, we apply I wp. 1 — p for 
p = l/(Wk), and one of the other Pauli operators: with equal probability p ■ t(d), where t is defined 
in ([12). 

E _® ft, where ft = R , *M ~ l/ W 

We note here that the choice of p is such that on average, each /c-tuple has only a small number of 
errors; the expectation of the number of errors is an absolute constant 1/10 (not a fraction of k). This 
will help, later on, to lower-bound the weight of the error modulo the group. 



5.3.3 Analyzing Penalty 

We first claim, that on average, £ has a relatively small penalty w.r.t. Q, using the fact that the expan- 
sion error is at least 0.32 as in the condition of Lemma |2] 

Fact 7 

Eg [Penalty] < pa\S\D R (1 - 0.02/fc) 

Proof: Let G = (L, R; E) denote the bi-partite graph corresponding to Q, with L being the constraints 
and R the qudits. Let S = T(U) be as before. Let the error process £ be the one defined above. For any 
constraint c G T(5) which is violated when applied to this error, observe that there must be a qudit 
% G supp(c) such that [c|j, £J / 0. We now would like to bound the number of constraints violated by 
£ using this observation, and linearity of expectation. 

For an edge e£fi connecting a qudit i in S and a constraint c in T(S), let x(e) denote the binary 
variable which is 1, iff the error term £i on does not commute with c|j. In other words, an edge 
marked by 1 is an edge whose qudit may cause its constraint to be violated. By construction, for each 
e££ which connects the qudit i and the constraint c we have 

Eg[x(e))=p(l-t). (3) 

This is true since a constraint c restricted to the qudit i, c|j does not commute with the error restricted 
to the same qudit i, £- u iff both £j is non-identity (which happens with probability p) and is not equal 

to c|j. 

If we had just added now x(e) over all edges going out of S (whose number is \S\Dr), then by 
linearity of expectation, this would have given an upper bound on the expected number of violated 
constraint equal to 

J2p(l-t)=P\S\D Ra (d). (4) 

e 

Unfortunately this upper bound does not suffice; to strengthen it we would now like to take 
advantage of the fact that many of those edges go to the same constraint, due to the fact that the 
expansion is bad; thus, instead of simply summing these expectation values, we take advantage of 
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the fact that two qudits touching the same constraint cannot contribute twice to its violation. We note 
that the bound we get does not gain back the full factor of 1 — e but a worse one. 

Let Ei n j C E be a subset of the edges between S to T(S) chosen by picking one edge for each 
constraint in T(S). For an edge e G E let c(e) denote the constraint incident on e, and let ej n j(c(e)) 
denote the edge in Ei n j that is connected to c(e). 

We now bound the expectation by subtracting x(e) from the sum, if the Boolean variable x(ei n j (c(e))) 
is 1; this avoids counting the violation of the same constraint twice due to the two edges. We have: 



Eg [Penalty] < E £ 



Yl x ( e )+ Y {l - x{e inj {c{e)))) ■ x{e) 



Note that it may even be the case that some edges may cause constraints to become "unviolated", so 
the actual bound may be even lower. Expanding the above by linearity of expectation: 

E[Penalty}< Eg [z(e)] + Eg [x(e)\ - Eg [x(e inj (c(e))) ■ x(e)] = 

e&E in j e<£E inj e£E inj 

^Eg[x(e)] + Eg[x(e mi (c(e)))-x(e)]. 

We have already calculated the first term in the sum in Equation |4j We now lower bound the 
correction given by the second term. We use the fact that for any e ^ Ei n j 

Eg [x(e in j(c(e))x(e)] = B £ [x(e in j(c(e)))}B £ [x(e)} 

since £ is independent between different qudits. We can thus substitute Equation|3j and get: 

Eg [Penalty] < pa\S\D R - \S\D R e(pa) 2 . 
where we have used the fact that \Ei n j\ = \S\Dre. This is equal to 

pa\S\Dn(l — pas). 

Using p = l/(Wk), e > 0.32, a(d) > 2/3, we get the desired bound. ■ 



5.3.4 Towards analyzing the weight: Proof of the Onion fact 
Proof: (Of Factg If A| r(u) = / then 

wt (£g\ r (k)( u ^) = wt [£g\ T (u)) = wt (£\r( u )) = *■ (5) 

Otherwise, A|r( u ) is non-identity and so has at least one non-identity coordinate, and also, since A is 
non-identity, by the assumption on the succinctness of Q we have wt(A) > k. 

Moreover, we claim that wt ^A| r ( fe )^ u ^ > k. Otherwise, consider the following process. Start 

with the constraint u, and consider the qudits in T(u) = (u). Now add the qudits belonging to all 
constraints in T^(u); Then add the next level, and so on until we have added add qudits belonging 
to r( fc )(w). By the pigeonhole principle, if wt ^A| r ( fe )^^ < k, then there must exist a level t s.t. 
1 < t < k where A has zero support on qudits added in this level. This is in contradiction to the 
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fact that the distance of the code is at least k, since we claim that A = A| r (t_iw u \, is in the centralizer 
Z(C7) but its weight is less than k. To see that A is in the centralizer, we observe first that A commutes 
with all elements of Q that act only on qudits in T^~ l \u), and since A agrees with A on r(* _1 )(u), A 
also commutes with them. We also observe that A trivially commutes with all elements in Q whose 
support does not intersect T^ t ~ 1 \u). Hence we only need to worry about those terms that act on at 
least one qudit in T(*)(u) — T^ 1 )^) and at least one qudit in T^^u). Let v be some such term. 
Note that v cannot act on any qudit outside rW(u) by definition (of the TW(u)'s). We know that A 
commutes with v. But by the choice of t, we know that A is trivial on those qudits added at the tth 
level, and hence A restricted to ^'(u) (which contains the qudits of v) is the same as A restricted to 
r^ <_1 )(n). And so A restricted to T^^^u) commutes with v. 

We showed that A is in Z(Q). If it also belongs to Q, this contradicts succinctness of Q; otherwise 
it is in 7j{Q) — Q implying the distance of C is at most k — 1, contrary to assumption. This means that 
wt ^A|p( fc )( u ^ > k. Therefore, we now know that 



wt (£g\ 



rW(u)) ^ wt ( A lr«(«)) - wt ( £ lrW(«)) = ( 6 ) 



wt ( A lrW(«) j-wt (£| r (o) (w) j >k — i. 
Taking the minimal of the bounds from Equations (|5|> r ([6]) completes the proof. ■ 

5.3.5 Analyzing error weight 

We note that the expected weight of £ is p\S\ and since \S\ is linear in n, by Chernoff the probability 
that the weight of £ is smaller than by a constant fraction than this expectation is 2~ n( - n \ We need to 
show a similar bound on the weight modulo the centralizer group; given that 5 < dist{C)/2 we only 
need to bound the weight modulo the stabilizer group. Let A e Abe some element in the stabilizer 
group and let £g = A£. We now need to lower-bound wt(£g). 

Fact 8 For integer k, let k = \ k/2\ +1. Let y(k) : [4, oo] h> R be the function: 



y{k) 



We claim: 



' 1 - 2(-^ +1 )'°3( fc )+fc-2.3A:+4.54 ^ > yi 

0.9999 6 < k < 11 

0.9992 k = 5 

0.9985 k = 4 

Prob £ {wt{£g) < \S\py(k)) = 2^^ . 



Proof: Let x ~ B(k,p = l/(10/c)) denote a random variable which is the sum of k i.i.d Boolean 
variables, each equal to 1 with probability p; in other words, x is a binomial process; B(i) = Prob(x = 
i). Let Ui = {u G U\wt(£\ r ^) = i} be the set of constraints in which exactly i errors occurred. Using 
the Hoeffding bound, for a given i G [k] and a given constant x > 0, we have 



Probe 



\Ui\ R ,., 



> X I = 2- n(n) (7) 
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By the union bound, we have that for any constant x > 0: 



Probg I 3i, s.t. 



\U\ 



Bi] 



>X 



Since the set U is a ^-independent set, then the sets {^^(u)} ueU are non-intersecting so 

wt{£ g ) >^2wt \£g\ r (h) {u) ) , 
ueu 

By the onion fact (6 1, for each u G Ui we have wt ^elrW( u )J — m * n {*) & ~~ *}/ hence 



(8) 



(9) 



wt(£g) > \Ui\min {i, k — i] = — -^min {«, A; — i} 
ie[k] ie[k] 



using A;|t/| = \S\. 

Therefore, using equation dH} w.p. close to 1 we have 



wt(£ g ) > ^ ^2(B(i)-x)min{i,k-i} > ^ I ^ B(i)min {i, k — i} — 2~ K " \ . (10) 
te[fc] \ie[fc] 

for x = 2- fc2 /^ 2 - 

We separate the rest of the proof to two cases: k > 12 and 4 < k < 12. We start with the case 
k > 12. Recall k = [k/2\ + 1. Let 

A loss = Y,B{i){2i-k). 

i>k 

Then by equation p0| we have that with probability exponentially close to 1 



|5| 



-fc 2 



,ie[fc] 



pk-2~ k - A, 



lost 



(11) 



In the rest of the proof for k > 12 we upper-bound Ai oss and substitute in the above equation to 
derive the desired result. Using an upper-bound of the binomial, we have: 



B(k) = -pf < 2 fc • (io*;)-*(i -pf < rt(rt fc < 2-*m*)+*- 3 - 3 * , 

For any i > k and p < 1/2 we have 

B( < + 1) = B(0(^) ( T ^)< B (0 I ^<*fl(i) 



(12) 



(13) 



Substituting equations ( 13 1 and (021 in the expression for Ai oss we have: 



A Zoss = ^B(i)(2i-fc) < 2' 



klog(k)+k—3.3k 



i>k 



i>k 



< 2 -fci^(*)+fc-3.3fc+l+*^^(i-*)^ _ ^/ 2 j) 



(14) 



(15) 



i>k 
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Changing summation i — [k/2\ i->- j we have the above is at most: 

[-fc/2i r*/*i 

2 -Mog(fc)+fe-2.3fc+l yT-? +1 j < 2 -^09(fc)+*;-2.3fc+l p-j +1 k (16) 

[fc/21 

< 2-klog(k)+k-2.3k+lf t ^ p - ^ 4 " 1 < 2~' t log(k)+k-2.3k+l ^ .]_]_<; 2(-* ; + 1 )* s( fc )+ fc - 2 - 3 * : + 1 - 2 (J 7) 

i>i 

where in the last inequality we bound the sum by ^ i>0 1/V, and set p = l/(10/c) < 1/100, using 
k > 12. Substituting this value in |llj | we have that with probability 2 _f ^ n ) close to 1, 

> M ^pfc _ 2(-^+ 1 )W( fc )+fc-2-3fe+1.21^ 

where in the last inequality we used again k > 12. Continuing, using p = ^ the above bound is 
equal to 

= |% (l - 2 (-^+ 1 )^( fc )+ fc - 2 -^+ 1 - 21 +^(10)^ > \ S \py(k), 

for all k > 12. For values of 4 < k < 12 we substitute directly in equation ( jlO) , evaluate, and show 
it is at least 



5.3.6 Concluding the proof of lemma (|2j 

Proof: By fact j7j| the average penalty of £ is small on average, i.e. 

E [Penalty{£)} < \S\D R pa{l - 0.02/ k) = P. 
Yet, by fact |8]l w.p. exponentially close to 1, we have 

wt(£ g ) > \S\py(k) 4 W /oM , > \S\p ■ 0.99. 
Similarly, by the Hoeffding bound w.p. exponentially close to 1, we have 

wt(£ g ) < |S|p(l + 0.01)^ W high . 

Since all penalties are non-negative, we conclude that conditioned on \ wt(£g)/(\S\p) — 1| < 0.01, 
we have E [PenaZiy(£)] < P + 2~ n( - n \ Therefore, there must exist an error £, whose weight modulo 
Q deviates by a fraction at most 0.01 from \S\p, and whose penalty is at most P + 2~ n ( n \ 

We would like to bound the robustness of this error, which is the ratio of the penalty to its relative 
weight times D R . We get that its robustness is at most 

_P + 2" n (") . 1 \S\D R pa{\ - 0.019/fe) _ /1-0.019/AA 
r ~ D R W low -D~ R \S\pMk) ~ a { yjk) J' ( } 

We now note that in the last expression, for all k > 12, the ratio is at most 1 — 0.01/ k. For 

all values of 4 < k < 12 we substitute the appropriate value of y(k) and get similarly that the ratio 
1 ~y(°fc) 9 * s a * mos t 1 ~~ 10~ 3 . Hence, the robustness of the error, r is at most a(d)(l — j gap ) where ^ gap 
is as defined in the statement of Theorem|4] 
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7 Appendix 

For S C R let C T(S) denote the subset of the neighbors of S with exactly one neighbor in S. 

Similarly, let T>2{S) denote the subset of neighbors with at least two neighbors in S. 

Proof of factg): 

Proof: The average degree of a vertex in r(5) w.r.t. \S\ is at most rgnf^n^ = I^i- Let ai denote the 
fraction \Ti(S)\/\T(S)\. Then 

1 

= ail + (1 — OL\)m, 

where m is the average degree of a vertex with at least two neighbors in S. Then 

em 

ui = 1 -. 

m — 1 

Since m > 2, then a\ is minimized for m = 2, and therefore 

ai > 1 - 2e. 

■ 

Proof of fact 

Proof: By definition, we have \T(S)\ > \S\D R (1 - e). Let E inj C E(S) be a subset of the edges 
incident on S such that each u G T(S) has a single neighbor in S connected by an edge of Ei n j. Then 
E ini is of size T(S) which is at least \S\D R (1 - e). Also \E(S)\ = \S\D R , thus \E(S) - E inj \ < \S\D R e. 
Therefore |T> 2 (5)| < \S\D R e. Hence,Ti(5) = r(5)-r> 2 (5) is of size at least \S\D R (l-e)-\S\D R e = 
\S\D R (1 — 2e). Therefore, there exists a vertex v e 5 with at least Z?r(1 — 2e) neighbors in ri(S'). Since 
v has D R neighbors in T(5), then the fraction of neighbors of v with at least two neighbors in S is at 
most 2e. m 
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Proof of Claim ([T): 



Proof: The construction of [24], generates explicitly for any e, r a right-regular bi-partite graph G = 
(L, R; E) whose right degree is Dr such that |£|/|-R| =l — r, and for any subset S C R, \S\ < \R\S the 
neighbor set of S is of size at least \S\Dr(1 — e), where Dr is the right degree of G. Note that since 
the right degree is Dr, the average left degree is jD^|i2|/|L| = Drj^, which is a constant given that 
Dr is a constant. 

The code is defined by assigning to each left node a parity check over its incident vertices. Let us 
lower bound the rate of this code: it is at least r = (\R\ — \L\)/\R\, since each constraint in L removes 
one dimension of the space. The minimal distance of the code is at least 5, since any non-zero word 
of weight at most 5 is rejected, since there exists at least one check term that "sees" just a single bit at 
state 1, by Fact jl]). 

Hence, these are so-called "good" codes. Furthermore, their robustness is at least 1 — 3e since an 
error on a set of bits S of size \S\ < Sn, is examined by at least \S\Dr(1 — e) constraints. By Fact ([TJ at 
least 1 — 2e of those constraints, examine S in exactly one location; all constraints that touch a given 
error set S in exactly one location will be violated; hence the total number of constraints that will be 
violated is at least \S\D R (1 - e)(l - 2e) > \S\D R (1 - 3e). ■ 
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